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DETAILED ACTION 
Remarks 

1. In response to communications filed on 07-June-2004, claims 1-18 are presently pending in 
the application, of which claims 1, 6, 10, 14 and 17-18 are in independent form. 

Claim Rejections - 35 USC §103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

3. Claim 1-4, 10, and 14-16 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Blandford (U.S. Patent No. 6,470,449) in view of Metcalfe (U.S. Publication No. 
2001/0027446 Al.) 

As to claim 1, Blandford teaches a method of generating a diary record (see Abstract), 
comprising the steps of: 

accepting user input responsive to the step of prompting (see column 4, hnes 58-59, and 
see column 15, line 66 through column 16, line 1, also see figure 24); 
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adding a record to a database defining the historical record including at least one of data 
resulting from the step of classifying and data resulting from the step of accepting (see 
column 14, lines 30-42, and see column 15, lines 11-15.) 

Blandford does not teach: 

classifying at least one of audio, video, and text input to a computer and generating an 
indicator of an event responsively thereto; and the event being unrelated to a calendar/diary 
appUcation; and 

prompting a user, by a calendar/diary appUcation, to enter data relating to the event for 
incorporation in a historical record of events pertaining to a user. 

Metcalfe teaches an electronic system for regulating activities (see Abstract), m which he 
teaches: 

classifying at least one of audio, video, and text input to a computer and generating an 
indicator of an event responsively thereto; and the event being unrelated to a calendar/diary / 
appUcation (see figure 2 and see paragraphs 35 and 38-39); and 

prompting a user, by a calendar/diary appUcation, to enter data relating to the event for 
incorporation in a historical record of events pertaining to a user (see paragraph 39, 41 and 
82.) 

Therefore, it would have been obvious to a person having ordinary skill in the art at the 
time the invention was made to have modified Blandford to include classifying at least one of 
audio, video, and text input to a computer and generating an indicator of an event 
responsively thereto; and the event being unrelated to a calendar/diary application; and 



Application/Control Number: 09/73 9,475 Page 4 

Art Unit: 2165 

prompting a user, by a calendar/diary application, to enter data relating to the event for 
incorporation in a historical record of events pertaining to a user. 

It would have been obvious to a person having ordinary skill in the art at the time the 
invention was made to have modified Blandford by the teaching of Metcalfe , because 
including classifying at least one of audio, video, and text mput to a computer and generating 
an indicator of an event responsively thereto; and the event being unrelated to a 
calendar/diary application, would enable the system to incorporate multimedia entries to the 
user's records, and prompting a user, by a calendar/diary application, to enter data relating to 
the event for incorporation in a historical record of events pertaining to a user, would enable 
the user to enter information where the system would maintain the information in a user's 
historical log. 

As to claim 2, Blandford as modified, teaches wherein the at least one of data resulting 
from the step of classifying and data resulting from the step of accepting includes data 
resulting from the step of classifying (see Metcalfe , paragraphs 35 and 38) and data resulting 
from the step of accepting (see Blandford , column 4, Unes 50-59.) 

As to claim 3, Blandford as modified, teaches wherein the event includes writing an 
email letter (see Metcalfe , paragraphs 74 and 82.) 



As to claim 4, Blandford as modified, teaches wherein the event includes writing a letter 
on a text application other than the calendar/diary application (see Blandford , figures 1 and 8, 
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and see column 11, lines 56, where "word processor" is taught, also see Metcalfe, paragraphs 
74 and 82.) 

As to claim 10, Blandford teaches a method of generating a diary record (see Abstract), 
comprising the steps of: 

detecting one of a passage of time since an entry of a record into a diary database and a 
time of day (see column 3, lines 8-1 1, see column 4, lines 17-20, and see column 6, lines 54- 
60); 

accepting data to form a new record in a diary (see column 4, lines 58-59, and see column 
15, line 66 through column 16, line 1, also see figure 24); and 

adding a new record responsive to a result of the step of accepting (see column 14, lines 
30-42, and see column 15, lines 11-15.) 

Blandford does not teach prompting a user to enter a diary entry responsively to the step 
of detecting. 

Metcalfe prompting a user to enter a diary entry responsively to the step of detecting (see 
paragraph 39 and 41.) 

Therefore, it would have been obvious to a person having ordinary skill in the art at the 
time the invention was made to have modified Blandford to include prompting a user to enter 
a diary entry responsively to the step of detecting. 

It would have been obvious to a person having ordinary skill in the art at the time the 
invention was made to have modified Blandford by the teaching of Metcalfe , because 
including prompting a user to enter a diary entry responsively to the step of detecting, would 
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enable the user to enter information relating to the diary record relative to the time or times 
when the transaction is to be performed, as taught by Metcalfe (see paragraph 39.) 

As to claim 14, Blandford teaches a method of generating a diary record (see Abstract), 
comprising the steps of 

extracting current events or historical data from an external data resource (see column 4, 
lines 65-67, and see column 14, lines 49-60); 

adding data resulting from the step of extracting to data resulting from the step of 
accepting to the diary database (see column 14, lines 30-42, and see column 15, lines 11-15.) 

Blandford does not teach accepting data descriptive of at least one of an appointment and 
an event for inclusion in a diary database. 

Metcalfe teaches accepting data descriptive of at least one of an appointment and an 
event for inclusion in a diary database (see paragraphs 39-40 and 55.) 

Therefore, it would have been obvious to a person having ordinary skill in the art at the 
time the invention was made to have modified Blandford to include accepting data 
descriptive of at least one of an appointment and an event for inclusion in a diary database. 

It would have been obvious to a person having ordinary skill in the art at the time the 
invention was made to have modified Blandford by the teaching of Metcalfe , because 
including accepting data descriptive of at least one of an appointment and an event for 
inclusion in a diary database, would enable the user to enter information relating to an event 
or an appointment, based on the actual time the event/appointment is to take place, as taught 
by Metcalfe (see paragraph 39.) 
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As to claim 15, Blandford as modified, teaches wherein the step of adding includes 
accepting user input data indicative of instructions to modify the current events or historical 
data (see Blandford , Abstract, and see column 4, Unes 17-35, and see column 10, line 57 
though column 1 1, line 18, also see Metcalfe , paragraphs 57 and 82.) 

As to claim 16, Blandford as modified, teaches wherein the step of adding includes 
correlating a date corresponding to the current events or historical data with a date diary data 
entered in the diary database (see Blandford , column 3, lines 8-11, see column 4, lines 17-20, 
and see column 6, lines 54-60.) 

1 

4. Claim 5 is rejected under 35 U.S.C. 103(a) as being unpatentable over Blandford (U.S. Patent 
No. 6,470,449) in view of Metcalfe (U.S. Publication No. 2001/0027446 Al), as appUed to 
claims 1-4, 10, and 14-16 above, and further in view of Hayes-Roth (U.S. Publication No. 
2002/0005865.) 

As to claim 5, Blandford as modified does not teach wherein the event includes a change 
in a mood of the user. 

Hayes-Roth teaches authoring contents for interactive agents (see Abstract), in which he 
teaches wherein the event includes a change in a mood of the user (see paragraphs 86 and 
386, and see claim 23.) 
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Therefore, it would have been obvious to a person having ordinary skill in the art at the 
time the invention was made to have modified Blandford as modified, to include wherein the 
event includes a change in a mood of the user. 

It would have been obvious to a person having ordinary skill in the art at the time the 
invention was made to have modified Blandford as modified, by the teaching of Hayes-Roth , 
because having the event including a change in a mood of the user would enable the system 
to take into consideration the user's state-of mind (mood), and be able to target events, 
articles, items to for presenting to the user according to the user's present mood. An 
advanced use of the Mood System might be to model the user's mood based on the words 
they use and then customize the interaction based on what you perceive is the user's state of 
mind, as taught by Haves-Roth (see paragraph 86.) 



5. Claim 6 is rejected under 35 U.S.C. 103(a) as being unpatentable over Blandford (U.S. Patent 
No. 6,470,449) in view of Metcalfe (U.S. PubUcation No. 2001/0027446 Al), and further m 
view of Berenson et al (U.S. Publication No. 2001/0049617.) 

As to claim 6, Blandford teaches a method of generating a diary record (see Abstract), 
comprising the steps of 

accepting data towards the making of a new record in a calendar apphcation (see column 
4, Imes 58-59, and see column 15, Une 66 through column 16, Une 1, also see figure 24); and 

generating a diary record responsive to a result of the steps of accepting and prompting 
(see column 14, lines 30-42, and see column 15, Unes 1 1-15.) 
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Blandford does not teach prompting a user for greater detail in an event defined by the 
record. 

Metcalfe prompting a user for greater detail in an event defined by the record (see 
paragraph 39 and 41.) 

Therefore, it would have been obvious to a person having ordinary skill in the art at the 
time the invention was made to have modified Blandford to include prompting a user for 
greater detail in an event defined by the record. 

It would have been obvious to a person having ordinary skill in the art at the time the 
invention was made to have modified Blandford by the teaching of Metcalfe, because 
including prompting a user for greater detail in an event defined by the record, would enable 
the user to enter additional information relating to the diary record, in order to complete 
and/or gather historical information regarding a diary record. 

Blandford as modified, still does not teach automatically generating a diary record. 

Berenson et al teaches a web-driven calendar updating system (see Abstract), in which he 
teaches automatically generating a diary record (see Abstract, and see paragraph 19.) 

Therefore, it would have been obvious to a person having ordinary skill in the art at the 
time the invention was made to have modified Blandford as modified, to include 
automatically generating a diary record. 

It would have been obvious to a person having ordinary skill in the art at the time the 
invention was made to have modified Blandford as modified, by the teaching of Berenson et 
al, because automatically generating a diary record would enable the system to use 
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data/information entered by a user and generate and/or update an entry in the calendar/diary 
system based on the user provided information. 

6. Claims 17-18 are rejected under 35 U.S.C. 103(a) as being unpatentable over Blandford (U.S. 
Patent No. 6,470,449) in view of Haves-Roth (U.S. PubUcation No. 2002/0005865.) 

As to claim 17, Blandford teaches a method of generating a diary record (see Abstract), 
comprising the steps of 

accepting user input data descriptive of personal events to be recorded in a diary database 
(see column 4, lines 58-59, and see column 15, line 66 through column 16, Une 1, also see 
figure 24.) 

Blandford does not teach: 

sensing and classifying states, events, or moods of a user or the user's environment; 
generating an index responsive to the step of sensing; and 
adding the index and the user input to the diary database, 

Haves-Roth teaches authoring contents for interactive agents (see Abstract), in which he 
teaches: 

sensing and classifying states, events, or moods of a user or the user's environment (see 
Abstract, and see paragraphs 39, 46-51, 84, 86, and 385.) 

generating an index responsive to the step of sensing (see paragraph 65, and see figure 1); 

and 
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adding the index and the user input to the diary database (see paragraph 389, and see 
figures 6-7.) 

Therefore, it would have been obvious to a person having ordinary skill in the art at the 
time the invention was made to have modified Blandford to include sensing and classifying 
states, events, or moods of a user or the user's environment; generating an index responsive 
to the step of sensing; and adding the index and the user input to the diary database. 

It would have been obvious to a person having ordinary skill in the art at the time the 
invention was made to have modified Blandford by the teachings of Hayes-Roth , because 
including sensing and classifying states, events, or moods of a user or the user's environment; 
generating an index responsive to the step of sensing; and adding the index and the user input 
to the diary database, would enable the system to incorporate indicators of the user's mood 
changes, as well as other event/state variables with the diary records, so that the agent can 
retrieve contents based on the values of the state variables and user mood/behavior, as taught 
by Hayes-Roth (see paragraph 389.) 

As to claim 18, Blandford teaches a data medium having instructions thereon for 
implementing a method for generating a diary record (see column 17, Une 66 through column 
18, line 14, and see column 18, lines 41-64.) 

For the remaining steps of this claim, applicant is directed to the remarks and discussions 
made in claim 17 above. 
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Allowable Subject Matter 

7. Claim 7-9 and 1 1-13 are objected to as being dependent upon a rejected base claim, but 
would be allowable if rewritten in independent form including all of the limitations of the 
base claim and any intervening claims. 

8. The following is a statement of reasons for the indication of allowable subject matter: 

The prior art of record, Blandford (U.S. Patent No. 6,470,449), Berk et al (U.S. 
Publication No. 2002/00497831 Berenson et al OJ.S. Publication No. 2002/0049617), Haves- 
Roth (U.S. PubUcation No. 2002/0005865), and Metcalfe (U.S. Pubhcation No. 
2001/0027446 Al ) do not disclose, teach, or suggest the claimed Umitations of (in 
combination with all other features in the claim): 

wherein the step of automatically generating includes: 

correlating selected user input from the step of accepting with data in an external data 
store; and 

generating a detailed description of a portion of the data accepted in the step of accepting 
responsively to the step of correlating whereby additional data from the external data is used 
to clarify the data accepted in the step of accepting, as claimed in claim 7. 

Claims 8-9 and 1 1-13 are objected to as being dependent from the objected to dependent 
claim 7. 
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Response to Arguments 
9. Applicant's arguments presented in the reply to previous office action filed on 07-June-2004, 
with respect to the rejected claims m view of the cited references have been fully considered 
but they are moot in view of the new grounds of rejection. 



10. The examiner's introduction of the new grounds of rejection (detailed above) was not 
necessitated by the applicant. Therefore, this Office Action is made Non-Final. The 
examiner has introduced the Metcalfe reference (U.S. PubUcation No. 2001/0027446 Al), 
specifically to address the claim limitations of "classifying at least one of audio, video, and 
text input to a computer and generating an indicator of an event responsively thereto", and 
"prompting the user, by a calendar/diary application, to enter date relating to the event". 

11. Any inquiries concerning this communication or earlier communications from the examiner 
should be directed to Tony Mahmoudi whose telephone number is (571) 272-4078. The 
examiner can normally be reached on Mondays-Fridays from 08:00 am to 04:30 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Dov Popovici, can be reached at (571) 272-4083. / 



Conclusion 




tm 



SAM RIMELL 
PRIMARY EXAMINER 



January 4, 2005 



